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Optimization process is normally implemented to solve several objectives in 
the form of single or multi-objectives modes. Some traditional optimization 
techniques are computationally burdensome which required exhaustive 
computational times. Thus, many studies have invented new optimization 
techniques to address the issues. To realize the effectiveness of the proposed 


techniques, implementation on several benchmark functions is crucial. 


In solving benchmark test functions, local search algorithms have been 
Keywords: rigorously examined and employed to diverse tasks. This paper highlights 
different algorithms implemented to solve several problems. The capacity of 
local search algorithms in the resolution of engineering optimization problem 
. including benchmark test functions is reviewed. The use of local search 
Local search algorithm algorithms, mainly Simulated Annealing (SA) and Great Deluge (GD) 
Meta-heuristic according to solve different problems is presented. Improvements and 
Optimization hybridization of the local search and global search algorithms are also 
Simulated annealing reviewed in this paper. Consequently, benchmark test functions are proposed 

to those involved in local search algorithm. 
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1. INTRODUCTION 

Artificial Intelligence (AI) encompasses technologies that are expanded from the word ‘technology,’ 
and technology is a word originating from ‘techne’; a Greek word that carries the meaning of "art" 
and "skill" [1-3]. Meanwhile, a refined technology encompasses a growing establishment of well-read and 
well-refined processes and skill. In the past decades, the use of meta-heuristic techniques has been expansive, 
particularly in the resolution of a lot of real-life applications including economic systems, management, 
communication, course-timetabling problems, scheduling, marketing strategies, production planning, 
logistics, design and routing [4-6]. Using these methods, the best solution for a given problem is generated, 
through the enumeration of all conceivable solutions of the full search space [7-9]. 

In the last few years, diverse algorithms have been used in diverse domains that relate to expert and 
intelligent systems, and these include management systems of water resources, benchmark test functions, 
and modelling the distribution of signal strength in communication systems [10-11]. For the already 
addressed problems, it appears that their optimal solutions appeared to be known as priori and were presented 
in the pre-specified early domains. Somehow, it is common that the optimal solutions are not already known 
for practical problems in expert and intelligent systems. Additionally, due to the intricacy of function of 
real-life situations, estimating the optimal solution is at times difficult to do. Hence, these algorithms will not 
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be as useful when the initial domains carry no optimal solution. Having precise estimation of the initial 
domains beforehand is therefore highly crucial [12-13]. 

The performance of diverse metaheuristics concerning the post-enrolment course timetabling 
problems has been empirically addressed in many studies [14-17]. In this regard, a comparison between 
metaheuristics must be fair, and so, the problem requirements to be addressed become the study’s focal point. 
For this purpose, similar problem-specific knowledge and equal settings of parameter are employed 
for all metaheuristics [8]. The settings of the parameter were established after series of appropriate parameter 
settings for each algorithm have been examined. The two criteria of conflict in single-based and 
population-based meta-heuristic can accordingly be observed in Figure 1. Single-based meta-heuristic 
typically has more capacities in exploitation while population-based heuristic appears to be more adept in 
terms of abilities of exploration [18]. The single-based and population-based meta-heuristic as well as their 
well-known techniques are further elaborated next. 
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Figure 1. The conflict between diversification and intensification [9] 


Improvement of local search algorithms (e.g., TS, SA, GD and HC) has been reported 
in the literature. Besides that, attempts to improve the algorithms’ performance through the enhancement of 
several of these parts were also demonstrated. Unfortunately, the review of the extant literature demonstrates 
the presence of information that is vague and inconsistent, particularly the resolution of the problem of 
benchmark test functions. 

This paper presents the local search algorithms based on benchmark test functions problem. 
Besides that, the improvement on the diverse divisions of local search algorithms for instance GD and SA 
grounded upon the benchmark test problems is scrutinised in this paper, in order to furnish valuable 
references and guidance to the relevant scholars. Following the introductory part of this paper, the next topic 
to be detailed out is the single base solution meta-heuristics. Then, in section 3, experiments executed on 
some selected benchmarks test function are illustrated. The final section concludes the paper. 


2. SINGAL-BASE SOLUTION META HEURISTIC 

Single-based meta-heuristic (SBH) or also dubbed as local search, encompasses a procedure which 
begins with a preliminary solution. At each iteration, a neighborhood operator is employed in the generation 
of an adjacent solution [19-20]. Single-based metaheuristics denote the methods of search which discompose 
one solution at a given time [21-22]. Examples of single-based methods include Tabu Search (TS), Simulated 
Annealing (SA), and Search of Variable Neighborhood (SVN). The single point-based methods usually begin 
at certain initial solution. Here, during each iteration, the present solution is equated and substituted by a 
neighbor, leading to the improvement of the objective function. Defined Neighborhood Structure is employed 
for the purpose. Then, when all candidate neighbors are inferior to the existing solution, the searching ends, 
because at this stage, a local optimum is already achieved [2]. Several metaheuristics with the capacity of 
manipulating just one solution at one time are discussed in the next subsections. These local search routines 
have the capacity in manipulating the solution space toward solutions of better quality. They are also able to 
intensify the search by efficiently searching for solutions of good quality. Accordingly, the extant literature 
shows the applications of these algorithms in the resolution of diverse problems associated with optimization 
and benchmark test functions problem. 


3. GREAT DELUGE 
The algorithms of great deluge (GD) by Duek [10] are comparable to those of SA except that the 
primary purpose of GD algorithms is to substitute those of SA. The parameters used in GD algorithms are 
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less in amount, compared to those employed in SA algorithms, but like SA algorithms, GD algorithms also 
always accept improved solutions while the worsening ones are accepted according to certain likelihood. 
GD algorithms accept worsening solutions in order to escape basin attraction (local optima) [23]. 
The applications of GD algorithms can be seen in many problems of optimization for instance those related 
to education timetabling such as timetabling of examinations, courses and school [24], problems related to 
sport timetabling and those related to Transportation timetabling. Burke et al. [25] indicated that only two 
parameters are needed when using GD algorithms as follows: time of search which is denoted by number of 
iterations, and level of quality of estimated solution. The entire procedures are then repeated for a given 
number of iteration as shown in the following algorithm 1. 


Algorithm 1: Pseudo_code of the Basic GD algorithm 


Determine initial candidate solution S; 
Determine initial level L; 
S=So; // Generation of the initial solution 
Choose the rain speed decay _ rate; // decay_ rate > 0 
Choose the initial water level Level; 
Repeat 
Generate a random neighbor solution S’ 

If f(S’) < Level: 

S=s’// accept the neighbor solution; 

Level = level — decay_rate; // update the water 
level until termination criterion is satisfied 
Until stopping criteria 
Output: Best solution found. 


The parameter (i.e. level) fully determines the quality of the attained outcomes and search time. 
In this regard, high rain speed parameter (decay rate) value will result in speedy algorithm but the obtained 
outcomes will have poor quality, while using the small rain speeds (decay rate) value will result in more 
superior algorithm which generate superior results within a greater computational time. 


4. SIMULATED ANNEALING (SA) 

The algorithms of simulated annealing (SA) by Kirkpatrick et al. [26] simulates the method of hill 
climbing except that it also carries a mechanism for escaping the local optima. In illustrating this algorithm, 
annealing entails the physical process of heating up a solid using high temperature and gradually cooling it 
down to a point where the solid crystallizes, with no more occurrence of changes while the system 
accomplishes a stable state. In other words, thermalisation has been achieved. Accordingly, a sequence of 
temperatures employed in the system thermalisation entails an annealing schedule or cooling schedule. 
The algorithm of SA was therefore based on the annealing process, and this algorithm is employed in 
addressing the problems associated with combinatorial optimization. SA begins from an initial solution that 
is produced randomly. During the process, the randomly chosen neighbour (move) of the existing solution is 
assessed, and the improved moves concerning the objective function are generally accepted while 
the worse moves are accepted but with some probability ascertained using the Boltzmann probability 
P which is computed using formula of P = e"a/t, with a representing the difference of the evaluation of 
objective function between the existing and the candidate solutions and t representing a parameter 
(called the temperature) that declines sporadically during the process of search following certain 
cooling schedule. In general, the cooling schedule choice affects the final solution particularly in terms 
of its quality. In this regard, cooling schedule that is faster will result in local optima that is faster 
as well [27]. Meanwhile, the use of slower cooling schedule will require a search that is more comprehensive, 
resulting in solution of higher quality. However, the use of slower cooling will consume more time. 
Many methods can be employed in the reduction of temperature during the search process. For instance, 
a progress formula (geometric cooling schedule) can be employed. Similarly, the temperature can be reduced 
using certain number of moves or just the successful moves. 

The effective application of SA algorithm has been observed in problems optimization for instance, 
problems of education timetabling such as timetabling of courses, examinations, and school, and problems 
of sport and transportation timetabling [28]. The subsequent pseudo-code is used in the establishment 
of the SA heuristic. As can be observed above, the implementation begins with state so and it ensues until the 
maximum of kmax steps are reached or until a state comprising energy emax or less is discovered. 
In this situation, the call neighbour(s) should produce a randomly selected neighbour of certain state s, 
and a random value should be returned by the call random and the value should fall in the range [0, 1]. 
The call temp (r) defines the annealing schedule and this should generate the temperature to be used 
correspondingly to the fraction r of the expanded time budget. The operation of SA algorithm is commenced 
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by the presence of initial solution x, and then, the solution is improved through the production of a 
candidate solution. The candidate solution would be accepted if it is superior to solution x, or, it will be 
accepted using the acceptance criterion that relies on a certain probability 7 (r encompasses a random number 
between O and 1). If 7 is lower than the value of (where entails the difference between the candidate 
and the existing solutions, while T denotes a control parameter known as temperature), the candidate solution 
is then accepted. Also, following a cooling schedule (6 encompasses the cooling rate), the temperature is 
progressively reduced. This process recurs and stops after the criterion of termination is achieved. 
Accordingly, the SA pseudo-code is shown below. 


Algorithm 2: Pseduo_code of Basic SA algorithm 


Generate the initial solution X = Xo 
Set the starting temperature T = Ty 
Set Cooling rate 8 
Set max number of trials each temperature i; 
Repeat 
i=0 
For i = 0 to ina do 
Generate a random neighbor 
AE = f(X’) — f(X) 
If AE< 0 
X = X’// accept the neighbor solution 
Else 
Generate a random number between 0 and | (7) 
if (r <e ae”) 


end 

Reduce temperature rate T= T * B 
Update the best solution 

Until stopping criteria is satisfied T = 0 
Return Best found solution. 


5. EXPERIMENT 

The present section presents the execution of a group of experiments on several benchmarks 
obtained from [28]. The experiments were to determine if the local search algorithms were indeed 
implemented in the studies. This was followed by the assessment and comparison of the proposed GD 
and SA algorithms, using an ensemble of expansively employed unimodal and multimodal standard 
benchmark functions. Table 1 tabulates 8 standard benchmark functions that have been expansively 
employed in past works particularly those that attempted to test the general-purpose optimization algorithms 
in terms of performance-wise. Here, the test functions in this group alongside their characteristics and 
dimension are displayed. Included in these benchmark functions are functions with different properties 
for instance, unimodal and multimodal. Table 2 tabulates a comparison between SA and GD. 


Table 1. Benchmark test functions (continue) 
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Table 1. Benchmark test functions 
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Table 2. Comparison of SA and GD 


Algorithm Performance Processing time Parameters 


Suitable in search space exploration because it — No. of iterations 
Great Deluge takes in the worse solutions following non- — Solution quality estimation 
improvement of several iterations. 


Has better speed than 
Simulated Annealing 


Suitable in search space exploration because it — No. of iterations 
Simulated takes in the worse solutions following non- Speed is less than that of — Initial temperature 
Annealing improvement of several iterations. based on Great Deluge — Final temperature 
probabilistic conditions — Decreasing rate 


6. CONCLUSION 

The algorithms of Great Deluge and Simulated Annealing have been presented in this paper with 
their performance are examined. As can be observed, both techniques have robustness and capacity in 
resolving countless of actual life problems. Great Deluge has better speed compared to simulated annealing 
because Great Deluge has less used parameters (two parameters) as opposed to simulated annealing that 
employs four parameters. Somehow, recent studies suggested that hybridizing two or more algorithms can 
increase the capacity of the resultant algorithm in solving actual life problems. As future scrutiny, 
these algorithms can also be recommended in the resolution of the benchmark test function. 
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